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Abstract — The linear-programming decoding performance of 
a binary linear code crucially depends on the structure of the 
fundamental cone of the parity-check matrix that describes the 
code. Towards a better understanding of fundamental cones and 
the vectors therein, we introduce the notion of absdet-pseudo- 
codewords and perm-pseudo-codewords: we give the definitions, 
we discuss some simple examples, and we list some of their 
properties. 

Index Terms — Absdet-pseudo-codeword, fundamental cone, 
low-density parity-check code, message-passing iterative decod- 
ing, perm-pseudo-codeword, pseudo-codeword. Tanner graph. 

I. Introduction 

In [1], MacKay and Davey discussed a simple technique for 
upper bounding the minimum Hamming distance of a binary 
linear code that is described by a parity-check matrix. Their 
technique was based on explicitly constructing codewords 
and on using the fact that the Hamming weight of a non- 
zero codeword is an upper bound on the minimum Hamming 
distance of the code. This approach was subsequently extended 
and refined in the papers [2] and [3]. (Note that [l]-[3] 
focused mostly on quasi-cyclic binary linear codes, however, 
the technique is more generally applicable since any binary 
linear code of length n can trivially be considered to be a 
quasi-cyclic code with period n.) 

In the technique by MacKay and Davey, the constructed 
codewords are binary vectors whose entries stem from certain 
determinants that are computed over the binary field. One 
wonders what happens if these determinants are not computed 
over the binary field but over the ring of integers. Do the 
resulting integer vectors still say something useful about the 
code under investigation? In this paper we answer this question 
affirmatively by showing that the resulting vectors (after 
replacing the components by their absolute value) are pseudo- 
codewords, i.e., vectors that lie in the fundamental cone of the 
parity-check matrix of the code. These pseudo-codewords, in 
the following called absdet-pseudo-codewords, are therefore 
important in the characterization of the performance of linear 
programming decoding [4], [5] and message-passing iterative 
decoding [6], [7]. 

The remainder of the paper is structured as follows. In 
Section we list basic notations and definitions. Then, in 
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Section |III] we formally define the class of absdet-pseudo- 
codewords and a closely related class of pseudo-codewords, 
so-called perm-pseudo-codewords. In order to get some initial 
understanding of these pseudo-codewords, in Section |IV] we 
construct them for some small codes. Afterwards, in Section IV] 
we discuss properties of these pseudo-codewords. We conclude 
the paper in Section |VT] 

II. Basic Notations and Definitions 

Let Z, M, and F2 be the ring of integers, the field of real 
numbers, and the finite field of size 2, respectively. If a is 
some vector with integer entries, then a (mod 2) will denote 
an equally long vector whose entries are reduced modulo 2. 
Rows and columns of matrices and entries of vectors will be 
indexed starting at 0. If M is some matrix and if TZ and S are 
subsets of the row and column index sets, respectively, then 
is the sub-matrix of M that contains only the rows of 
M whose index appears in the set TZ and only the columns 
of M whose index appears in the set S. If TZ equals the set 
of all row indices of M, we will simply write M5 instead of 
IsAiz.s- Moreover, we will use the short-hand S\i for iS \ {i}. 

Definition 1 Let M = (jnj,i)j^i be an n x n-matrix over some 
ring. Its determinant is defined to be 

n-l 

dct(M) = ^ sgii(cr) \Y ^jMj) ' 

cr j=0 

where the summation is over all n\ permutations of the set 
{0, 1, . . . , n— 1}, and where sgn(cr) equals +1 if a is an 
even permutation and equals ~1 if a is an odd permutation. 
Similarly, the permanent of M is defined to be 

Tl-l 

perm(M) = IT ^J-'-O) ' 

Clearly, for any matrix M with elements from a ring or field 
of characteristic 2 it holds that det(M) = perm(M). 

When we want to emphasize that the matrix M, of which 
we are computing the determinant or the permanent, is to be 
considered to be a matrix over the ring of integers, then we 
will write dctz(M) and perm2(M), respectively. Note that 
detz(M) (mod 2) = pcrmx(M) (mod 2). □ 
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Let H {hj,i)j,i be a parity-check matrix of some binary 
linear code. We define the sets J^(H.) and X(H) to be the set of 
row and column indices of H. Moreover, we will use the sets 
J,(H) ^{jej\ h,,, = 1} andXj(H) = {i e I \ = !}■ 
The Tanner graph that is associated to H will be denoted by 
T(H); the graph distance of bit nodes Xi and bit nodes Xi^ in 
T(H) will then be denoted by cfT(H) {Xt, X;/). (Note that this 
latter quantity is always a non-negative even integer.) In the 
following, when no confusion can arise, we will sometimes 
omit the argument H in the preceding expressions. 

Definition 2 The fundamental cone /C(H) o/ H is the set of 

all vectors u) G M" that satisfy 

uji^Q (for all i e I{H.)) , (1) 

uji uji, (for all j e J(H), for all i e X,(H)j . (2) 

A vector a; G ^(H) is called a pseudo-codeword. If such a 
vector lies on an edge o//C(H), it is called a minimal pseudo- 
codeword. Moreover, if u> G A^(H) n Z" and u) (mod 2) G C, 
then <jj is called an unsealed pseudo-codeword. (For a moti- 
vation of these definitions, see [7], [8]). □ 

Although the region in the log-likelihood ratio vector space 
where linear-programming decoding decides for the all-zero 
codeword is completely characterized by the minimal pseudo- 
codewords of /C(H), the knowledge of non-minimal pseudo- 
codewords is also valuable since such pseudo-codewords can 
be used to bound this decision region. 

III. Definition of Absdet-Pseudo-Codewords 
AND Perm-Pseudo-Codewords 

We start with the definition of det-vectors, absdet-vectors, 
and perm- vectors. As we will see, the properties of these 
vectors will then allow us to rename absdet-vectors and 
perm-vectors into absdet-pseudo-codewords and perm-pseudo- 
codewords, respectively. 

Definition 3 Let C be a binary linear code described by a 
parity-check matrix H 6 F™^", m < n. For a size-{m+\) 
subset S o/X(H) we define the det-vector based on S to be 
the vector u G'L" with components 



(-l)''^Wdctz(H5\,) 




ifi&S 
otherwise 



where r]s{i) G {0, 1, . 
set S. 



\S\ — 1} is the index of i within the 

□ 



Definition 4 Let C be a binary linear code described by a 
parity-check matrix H G F™'^", m < n. For a size-{m+\) 
subset S o/Z(H) we define the absdet-vector based on S to 
be the vector u) G Z" with components 



detz(H5y 



ifi&S 
otherwise 



Definition 5 Let C be a binary linear code described by a 
parity-check matrix H G F™^", m < n. For a size-lm+l) 
subset S of 1(H) we define the perm-vector based on S to be 
the vector U3 G Z" with components 



A j Permz(H5\j) i/i G 5 
1 otherwise 



□ 



Note that whereas det-vectors depend on the row ordering 
of a parity-check matrix, absdet-vectors and perm-vectors do 
not. 

Before proving some lemmas and theorems about these 
vectors, let us state and prove an auxiliary result. 

Lemma 6 Let C be a binary linear code described by the 
parity-check matrix H G F™^", and let u G K" be a vector 
that satisfies 



n -u^ = (i, 



(3) 



Then the vector u) G M" with components oji = ji^ij, i G X, 
satisfies G /C(H). 

Proof: In order to show that such a vector u) is indeed in 
the fundamental cone of H, we need to verify ([TJ and (|2]i. The 
way u) is defined, it is clear that it satisfies ([T]i. Therefore, let 
us focus on the proof that lj satisfies (|2]i. Namely, from Q 
it follows that for all j G J', X^iex ~ ^'^^ 

j G J, J2ieij ^1 ^ ^- ™^ impHes 



for all j G J and all i G Ij, showing that a; indeed 
satisfies (|2]i. ■ 

Lemma 7 Let C be a binary linear code described by the 
parity-check matrix H G F™^", m < n, and let S be a size- 
(m+1) subset o/I(H). The det-vector v based on S satisfies 



u (mod 2) G C . 



(in Z) 



(4) 
(5) 



Proof: Let = H ■ iv^ (in Z) be the Z-syndrome. Then, 
by the definition of the det-vector in Definition |3] 



= J2h,^,u, = ^(-l)''^«%,detz(H, 

ies 



iei 



s\0 



for any j G J(il). Let S = {io.h, . . . ,hn} ^ 2:(H). 
Observing that Sj is the the co-factor expansion of the Z- 
determinant of the (771+ 1) x (m+1) -matrix 



□ 









ho,ia 


ho.ii 






hlAi 




?7l— l,io 


^m — 1,21 





(6) 
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and noting that this latter matrix is singular (because at least 
two rows are equal), we obtain the result that s = 0, as 
promised. 

The proof of Q follows by noticing that H ^*^ = 0^ (in Z) 
implies that H • [u (mod 2))^ (mod 2) = O'''. ■ 

Theorem 8 Let C be a binary linear code described by the 
parity-check matrix H G F™^", m < n, and let S be a size- 
(m+1) subset o/X(H). The absdet-vector a; based on S is 
an unsealed pseudo-codeword of H, i.e.. 



u e /C(H) 

u} (mod 2) e C . 



(7) 
(8) 



Proof: Let v be the det-vector based on S. From 
Lemma|2]we know that satisfies H i/^ = 0^ (in Z). Because 
of this, and because uji = {uil for i S X, we can use Lemma|6] 
to conclude that indeed uj E /C(H). 

Finally, ([8]) is verified as follows. Lemma [7] shows that 
1/ (mod 2) G C, which, upon noticing that v (mod 2) = 
UJ (mod 2), implies that u) (mod 2) G C. ■ 

Theorem 9 Let C be a binary linear code described by the 
parity-check matrix H G E^^", m < n, and let S be a size- 
(m+1) subset o/Z(H). The perm-vector U3 based on S is an 
unsealed pseudo-codeword o/ H, i.e.. 



G /C(H) 
a; (mod 2) G C . 



(9) 
(10) 



Proof: In order to show (|9|l, we need to verify ([T]i and (|2|l. 
From Definition |5] it is clear that ui satisfies ([T]i. Therefore, let 
us focus on the proof that a; satisfies (|2]i. Fix some j G J7(H) 
and some i G Ij(H). If i ^ 5 then tj^ = and (l2]i is clearly 
satisfied. Therefore, assume that i E S. Then 



i'e5\i j'e(i\5)\i 

(*) x 

i'eS\i 



i'eS\i 



(**) 



= /ij,,;perm^(H5\i) = = 

where at step (*) we kept only the terms for which i" = i, and 
where step (**) follows from i G X, (H). Because j G J^(H) 
and i G Xj(H) were arbitrary, lj indeed satisfies (|2]i. 

Finally, ( flOl l is verified as follows. Let i/ be the det-vector 
based on S. Lemma Q shows that u (mod 2) G C, which, 
upon noticing that u (mod 2) = u) (mod 2), implies that 
LJ (mod 2) G C. ■ 



Xo6 




OXr. 




Figure 1. Tanner graphs of dumbbell-graph-based codes. Left: [7, 2, 3] binary 
linear code. Right: [9, 2, 4] binary linear code. 



Definition 10 Because of Theorems |S] and |9] absdet-vectors 
and perm-vectors will henceforth be called absdet-pseudo- 
codewords and perm-pseudo-codewords, respectively. □ 

IV. Examples 

In order to get a better feeling of what absdet-pseudo- 
codewords and perm-pseudo-codewords look like, let us dis- 
cuss some examples. 

Example 11 Consider the [4, 2, 2J binary linear code C based 

• U ■ . „ A U 1 1 0^ 

on the parity-check matrix H 



111 
3sdet-pseudo 



where n = 4 
codewords and 



and m = 2. Let us compute the a 
perm-pseudo-codewords for all possible subsets S of X(H) of 
size m+l = 3. We obtain the following list of absdet-pseudo- 
codewords: (0,1,1,0) (twice), (1,1,0,1), (1,0,1,1). These 
happen to be all the non-zero codewords of C. Moreover, this 
parity-check matrix yields the following list of perm-pseudo- 
codewords: (2, 1, 1, 0), (1, 1, 0, 1), (1, 0, 1, 1), (0, 1, 1, 2). Note 
that, up to scaling, (2, 1, 1, 0) and (0, 1, 1, 2) are the only non- 
codeword minimal pseudo-codewords of /C(H). □ 



Example 12 Consider the dumbbell-graph-based [7,2,3] bi- 
nary linear code described by the Tanner graph in Fig- 
ure [U (left) with ?i = 7 bit nodes and m = 6 check 
nodes. Obviously, there is only one subset S of X(H) of size 
m+l = 7 = n, i.e. S = X(H). This set S yields the absdet- 
pseudo-codeword (2, 2, 2, 4, 2, 2, 2). Note that this is the only 
non-codeword minimal pseudo-codeword of /C(H) (cf. [7], 
[8]). Moreover, for this example the perm-pseudo-codeword 
based on S happens to be also (2, 2, 2, 4, 2, 2, 2). □ 

Example 13 Consider the dumbbell-graph-based [9,2,4] bi- 
nary linear code described by the Tanner graph in Fig- 
ure [T] (right) with n = 9 bit nodes and m = 8 check nodes. It 
yields the absdet-pseudo-codeword (0, 0, 0, 0, 0, 0, 0, 0, 0) and 
the perm-pseudo-codewords (2, 2, 2, 2, 4, 2, 2, 2, 2). Note that 
this latter vector is the only non-codeword minimal pseudo- 
codeword of /C(H). □ 

Example 14 Consider a randomly generated (3, 4)-regular 
[20, 5] LDPC code based on a 15 x 20 parity-check matrix 
Hi that potentially contains four-cycles. The blue curve (top 
curve) in Figure |2] shows the AWGNC pseudo-weight cumu- 
lative histogram of the absdet-pseudo-codewords of Hi based 
on all subsets S of X(H) of size m+l = 16. 
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AWGNC pseudo-weight 



Figure 2. AWGNC pseudo-weight cumulative histograms of the absdet- 
PCWs (absdet-pseudo-codewords) of the parity-check matrices in ExamDle ll4l 
(The AWGNC pseudo-weight of a pseudo-codeword lj is defined to be 
^AWGNC^^) = [6], [7].) Blue curve (top curve): Hi. Red 

curve (bottom curve): H2. 



Eliminating four-cycles in T(Hi) by applying an edge- 
permutation procedure results in a Tanner graph T(H2) of 
a new code described by a parity-check matrix H2. The red 
curve (bottom curve) in Figure |2] shows the AWGNC pseudo- 
weight cumulative histogram of the absdet-pseudo-codewords 
of H2 based on all subsets S of X(H) of size m+1 = 16. 

Comparing these two curves, we make the following obser- 
vation: first, for Hi there are more absdet-pseudo-codewords 
than for H2 that equal the all-zero vector. As we will briefly 
discuss in the next section, this observation is related to the 
existence of four-cycles. Secondly, the curve related to Hi is 
to the left of the curve related to H2. This corroborates the 
common observation that codes based on Tanner graphs with 
four-cycles usually perform worse than codes based on Tanner 
graphs without four-cycles. □ 

V. Properties of Absdet-Pseudo-Codewords 
AND Perm-Pseudo-Codewords 

In this section we discuss some properties of absdet-pseudo- 
codewords and of perm-pseudo-codewords. Some proofs are 
shortened or omitted due to space restrictions. 

Remark 15 Using a well-known property of permanents 
of matrices with zeros and ones, it follows that the term 
perm^ (H ^^j) , which appears in the definition of perm- vectors 
in Definition |5] equals the number of perfect matchings in the 
Tanner graph T(H5Yi)- Moreover, because Theorem|9] showed 
that perm-vectors satisfy (|2]), we see that for every j E i/(H), 
Eq. ^ relates the set of perfect matchings in the Tanner graphs 

{T(H5v)},,x,(H)- ° 

Theorem 16 Let H be the parity-check matrix of a code 
whose associated Tanner graph is a tree, i.e., does not contain 
cycles. Then all entries of all absdet-pseudo-codewords and all 
entries of all perm-pseudo-codewords are either or 1. 

Proof: (Sketch.) A necessary condition for the Tanner 
graph T(H5y) to have at least two perfect matchings is the 
existence of a cycle in the Tanner graph. However, if T(H) is 
cycle-free then also T(H5y) is cycle-free. For perm-pseudo- 
codewords the claim then follows from Remark [TSl 



Moreover, for any set S, the entries of the absdet-pseudo- 
codeword are always upper bounded by the corresponding 
entries in the perm-pseudo-codeword, and so the claim also 
follows for absdet-pseudo-codewords. ■ 

Remark 17 For a parity-check matrix H, the existence of 
short cycles in T(H) has an influence on the list of absdet- 
pseudo-codewords. In particular, without going into the details, 
four-cycles imply more absdet-pseudo-codewords that equal 
the all-zero codeword. Related statements can be made about 
six-cycles, eight-cycles, etc.. As part of future research, it will 
be interesting to formulate probabilistic statements that will 
help characterizing long codes where not all absdet-pseudo- 
codewords can be listed by brute-force techniques. □ 

Remark 18 Note that the pseudo-codeword (2, 2, 2, 4, 2, 2, 2) 
that was found in Example [T2l can be seen as a canonical com- 
pletion with root X4 [6], [7]. (Strictly speaking, the canonical 
completion was only defined for check-degree regular codes, 
however, it is straightforward to suitably extend the canonical 
completion technique to Tanner graphs where the check nodes 
with the same graph distance to the root node have the same 
degree.) 

More generally, one can establish the following connection 
between Lemma |6] and the canonical completion. Namely, let 
uj G M" be the canonical completion with root Xi for some 
i e 1(H) and define 1/ G R" such that 



(if dT(H) {^i , 

(if (iT(H) {Xi , Xi. 



e AT) 

e 2Z \ 4Z) 



for all i' E 2^(H). (With this, u) obviously satisfies cj^/ = \iy.ir\ 
for aU i' G 1(H).) Let J'{li) be the subset of indices of 
check nodes that have only one neighboring bit node that is 
closer (in graph distance) to the root than they are to the root. 
It can then easily be verified that Hj^j ■ = 0^, which, 
with the help of Lemma |6] implies that lj E JC{iij',x). □ 

The next theorem relates absdet-pseudo-codewords to quan- 
tities that appear naturally in a certain Gaussian graphical 
model associated to T(H). In order to motivate the Gaus- 
sian graphical model in that theorem, remember that a Tan- 
ner/factor graph of a code represents the indicator function 

e c] = n.ei.A'(^o • n,e:7/i'(xi,) with /;(x.) 4 

[x,e{0,l}] and //(xij ^ [^^gj^a:;,(mod2) = O], and 
that the indicator function of the fundamental cone can be 
written as [uj E /C(H)] = Il.ei^K^O ' Ilje j ^'"('^i, ) 
with k[{bJi) = [xi ^ 0] and some suitably defined functions 
^^'(xi,). 

Theorem 19 Let C be a binary linear code described by the 
parity-check matrix H E F™^". For some arbitrary e > 0, 
consider the Gaussian graphical model for the length-n vector 
U defined by pu{u) oc H.^zi g'iiui) ■ Iljgjffi ("i,) with 



g[{ui) ^ exp^- 



, 9j (ui^ ) = cxp 
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Let S be a size-{m+l) subset o/I(H) and let S ^ 2^(H) \<S 
be its complement. (We assume that m < n.) Let Ui\s{s) be 
the square root of the minimum mean squared error when 
estimating Ui (with a linear or a non-linear estimator) based 
on the knowledge ofXJg ~ Ug. Then the components of the 
absdet pseudo-codeword oj based on S fulfill 

= lim 7515(e) •cr,|5(£) (11) 

for all i £ 2^(H), where 75 g{e) is a function of e, but 
independent of i £ 2r(H). 

Proof: First, we consider the case where i G S. From 
Definition |4] we see that oji = 0. On the other hand, Ui can 
perfectly be predicted based on the knowledge of of = u^, 
which implies a'^^^{e) = 0. Since 75 ^(e) (defined below) is 
bounded for all suitably small e > 0, we have proven ( fTTT i for 
i G S. 

Secondly, we consider the case where i £ S. We start by 
noting thatpu(u) can be written as pu(u) oc cxp (— ^u^Gu) 
with the positive definite matrix G = e^l„xn + H^H, where 
Inxn is the n X n identity matrix. Then, pus|U5(u5|u5) cx 
exp ^— iujG^i^u^ + n^l^u^^, with the positive definite 

matrix G^i^ = e^l(,„+i)x(m+i) + and with n^i^ 

being a linear function of u^. The inverse matrix of G^i^ 
is the covariance matrix R515 of U5 given U^. For i £ S, 
a well-known property of jointly Gaussian random variables 
says that the i-th diagonal entry of R515 equals (T^.^(e). 

Without loss of generality, we can assume that S ~ 
{0, 1, . . . ,to} and that i = 0. Because H5 ~ (H.^q^\Hs\q) , 
we obtain 





e^lixi + H|gjH{o} 


H[o}H5\o 









Since o-Q^gi^) is the (0,0)-entry of R^i^ = we have 

where 7515(e) y^det (G515) . In the limit e ^ we have 
lim det (^e^l„xm + HJn^oH5\o) = detz (^HjyoH5\o) 

= detz (hJ^o) • dctz (H5\o) - dctz (tlsxof = ^0 , 

where step {*) follows from Definition |4] Similar expressions 
easily follow for other i £ S, therefore proving ( fTTT i. ■ 

Remark 20 Remember that the differential entropy of an n- 
dimensional Gaussian random vector U with mean vector m 
and covariance matrix R is h{\J) = i log((27r c)" dct(R)) 
(in nats) [9]. Therefore, the result of Theorem [T9] can also be 
expressed as 

lim 7515(e) ■ cxp (^h{U^\Vs)^ 
for all i £ I, where 7515(e) = 7^75|s(e)- □ 



Remark 21 One can associate an electrical network to the 
Gaussian graphical model in Theorem [T9l [10], [11]. Theo- 
rem [19] can then be seen as relating oji to the square root of a 
certain effective (or input) resistance of some suitably defined 
electrical network [12] whose topology equals the topology of 
T(H). □ 

VI. Conclusions 

In this paper we have introduced the concept of absdet- 
pseudo-codewords and perm-pseudo-codewords towards a bet- 
ter understanding of the fundamental cone of a parity-check 
matrix. We have shown that these vectors are in the fun- 
damental cone and that it is therefore justified to call them 
absdet-pseudo-codewords and perm-pseudo-codewords. We 
have discussed some simple examples that show the relevance 
of these pseudo-codewords and we have highlighted some 
of their properties. There are many interesting avenues for 
further research of these pseudo-codewords. In particular, it 
promises to be worthwhile to relate them to the statements 
about matchings in [13], and to potentially combine them with 
the pseudo-codeword search algorithm in [14]. 
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